Entropy production and coarse graining in Markov processes

Coarse-graining with the relative entropy

ADK Entropy and ADK Entropy Rate in Irreducible- Aperiodic Markov Chain and Gaussian Processes

In this paper, the two parameter ADK entropy, as a generalized of Re'nyi entropy, is considered and some properties of it, are investigated. We will see that the ADK entropy for continuous random variables is invariant under a location and is not invariant under a scale transformation of the random variable. Furthermore, the joint ADK entropy, conditional ADK entropy, and chain rule of this ent...

Relative Entropy and Optimization-Driven Coarse-Graining Methods in VOTCA

We discuss recent advances of the VOTCA package for systematic coarse-graining. Two methods have been implemented, namely the downhill simplex optimization and the relative entropy minimization. We illustrate the new methods by coarse-graining SPC/E bulk water and more complex water-methanol mixture systems. The CG potentials obtained from both methods are then evaluated by comparing the pair d...

Coarse-Graining Approaches in Univariate Multiscale Sample and Dispersion Entropy

Abstract: The evaluation of complexity in univariate signals has attracted considerable attention in recent years. This is often done using the framework of Multiscale Entropy, which entails two basic steps: coarse-graining to consider multiple temporal scales, and evaluation of irregularity for each of those scales with entropy estimators. Recent developments in the field have proposed modific...

Entropy production and coarse graining of the climate fields in a general circulation model

9 We extend the analysis of the thermodynamics of the climate system by investigating the role 10 played by processes taking place at various spatial and temporal scales through a procedure of 11 coarse graining. We show that the coarser is the graining of the climatic fields, the lower is 12 the resulting estimate of the material entropy production. In other terms, all the spatial and 13 tempo...